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This resource guide provides a definition of and an 
evaluation design for community education prograffis. The author 
defines a ccmmunity education program as a planned response to 
ongoing community needs which is opera tionali^ed through coordination 
and scheduling of locally available resources to given target 
populations- The following evaluation techniques are suggested and 
defined; (1) model identification, (2) legal analysis, (3) colleague 
criteria evaluation, (4) statewide overview and (5) tracking. (NS) 
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Coiraminity Education 
Evaluation Design 



1* Deflnltiong 



A coffimunity educaf.ion program is an organized and systematic group self -improvament 
pro j act. Such a plan of action iQ a response to on going conmunlty needs analysis 
and ^ operationaltEsd in coordinating and scheduling locally available resources and 
services for givon target populations^ 

2, Glossary ; 

GoOTiunlty? A geographically identifiable group having corranon interests* 

Education: Be 1£= improvement within a given conmunity In school ^ out of 
school^ and in leisure* 

Program; A public and legal entity open to all without discrimination and 
with affirmative outreach to conmunity members in need. 

Projecti One of many activities undertaken by a local program. 

Organized; Structured; integrated; able to planp schedulep and Implement 
appropriate activities or projects, 

Systet^tlc; Thorough^ and regular; methodical; providing inter-related and 
non-^duplicated services from one central source. 

Needs A continuous determination of where the cotmnunlty is (status quo) 

Analysisi and where it needs and wants to go (self-Improvement)* 

Plan of A clear, concise^ and consistent statement of achievable and 
Actions measurable goals for a given time period. This plan must be 

developed with involvement of the conmunity served * 

Resourcesi Public bulldlngS|, property^ equipmentj funds^ and personnel* 

Services: Educational^ recreatipnal , cultural^ and other benefits that 

respond to the needsg. interests^ and services of a given conmunity. 
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3* Eya^Xuation 



In addition to local evaluation plans developed on a program by program basiSf 
* offer technical assistance to Community Education Programs in the following 
area SI 

MODEL TDENTIFICATION i 

Through an analysis of demographic characterlsties ^ programs 
with similar traits are clustered together for the identification 
of prototypes or models* Prototypes help in the understanding of 
cotmnon goals s cotimon procedures, and comn^on criteria of effectiveness 
applicable to a given subgroup of community education programs. 

B* LEGAL DEFINITION EVALUATION g 

Through an analysis of the minimum elements of a comnunity 
education program as defined by the Federal Registerp programs 
with similar legal characteristics can be clustered together* 
Such clustering helps in the understanding of prDgrams based 
in, schools and outside schools ^ 

C* COLLEAGIJE CRITERIA EVALUATION ^ 

Through an analysis of what conmunlty education program directors 
consider important and use to tneasure ef fectlvenesSf local program 
directors can self ^evaluate their programs through informal peer review. 
Such self --evaluation la useful ±u determining necessary program self- 
improvement e 

D. STATEWIDE OVERVIEW ; 

Through an analysis of models legal 5 and colleague data from other 
programs across the state, local directors of comnunity education 
programs can develop better needs assessment tecimiques and greater 
involvement of the cotranunlty served* 

TRACKING ' SYSTEMg 

Through an analysis of what each coTimunity education program has done 
in the decision making process $ local program directors cart describe 
how key rieclslons were made. Such data can be used in developing 
guidelines for program improvement . on a formative basis* 

D 
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MODEL IDENTIFICATION 



DEMOGRAPHIC DATA 
Qrtgin 

In September L976j University researchers asked certain questions in an 
attempt to develop an empirical definition of Conffnuiiity Education in the 
State* 

In October 3 State technical advisors formated these questions into a 
discussion documents Gormnunity Education Program directors revised the 
discussion docuTnent into a self-study outline that reflected statewide 
consensus* 

In November^ this self-study outline was completed by several local 
program directors* 

Content 

A copy of the demographic data self-study outline as revised and 
accepted by local program directors is attached* 

Part 2 
MODEL TYPES 

A listing of model types and sites is attached. 
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MODEL IDENTIFICATION 



The following are representative community aducation program models 
currently operating in New York Statei 



Model Type • Site Location 

BOCES ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ «^ ^ ^ * ^ = - ^ - ^ ^ ^Oswego 

CoTmnunity Involvementi Multi-Directional ^---------Syracuse 

Community Involvement Process | Regional-------------Elmira 

Cormnunity, School^ and Mu Iti -Agency | Urban, 

Suburban j Rural- ^^^^ -Ithaca 

Dropout Prevention-^ — = ^ — Lafayette 

Federal Career Education and CETA^--- — ^. -.st, Lawrence-Lewis 

Inter-Agency I Parks and Recreation; 

City Government------ --Penfield 

Neighborhood Development Corps | City 

Government Support-- — ~ Buffalo 

Rurali Senior Citizens — ^^^^^^^^ — ^ — ^ -Central Square 

Suburban ^^^^^^^^^^^^^^^ ---Rush-Henrietta 

Teacher Corps------------ -------- -------------------Potsdam 

Town^Village, and School Governmenti 

Target Areas — -----^ — ^--^ -Ossining 
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LEGAL DEFINITION EVALUATIO N 



The "minimum elements" of a coimiunity education program as defined 
by the Federal Register (FR 40i 240^ Dec* 12^ 1975i pp* 57936-7) have been 
analyzed to identify all observable components. 

Each minimum element has been correlated to a YES/NO question to be 
used In self-evaluation by the project director and by the person to whom 
the project director reportSs The following reporting code is useds 

Y^S identifies those elements that are present in 

the local program 

NO identifies those items that are not present in 

the local program 

BLANK identifies those items that are not applicable 
to the local program 

One self-evaluation profile is submitted for each local project. When 
appropriates ^ third party evaluation profile may also be developed although 
this would normally be unnecessary, 

A tabulation of several local profiles would give a good idea of how 
these programs compare with national criteria. 
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COLLEAGUE CRITERIA IDENTIFICATION 



Orlpin 

In Septamber I9765 local program directors were asked by State officials 
to supply brief responses to the following questional 

a) What are the most important components and 
characteristics of your program? 

b) What ineasurable criteria do you use to 
determine success of each component and 
characteristic? 

In Octoberi this mandate was discussed at a statewide meeting in order 
to give specific examples of components^ characteristics^ and criteria* 
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STATEWIDE OVERVXEW 



Mi overview of model, legal, and colleague data helps local program 
directors examine available cTiteria and ask questions hGlpful In the planning 
and evaluation processes that are part of each local program. For sample 
available criteria listed below, an appropriate question is given. 



Ayai lable _Cri ter ia 

Minimum elements listed in 
the Federal Register . 

Key program components 
recogniEed and ranked by 
professional Golleagues 
and peers. 

Effectiveness measures keyed 
to proposal objectives. 



Appropriate Question 

"Is the Federal Resister 
definition adequate?" 

"What else must be taken into 
consideration in school-abased 
and non-^school-based programs?" 

"What has been achieved?" 



With such an evaluation perspective, new programs can chart movement 
and older programs can recognize improvement scores. In this way^ programs 
across the State can work together on corranon goals whose success can be 
measured by mutually acceptable yardsticks* 
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raACKING_ SYSTEM 



Origin 

In September 1976^ local directors were introduced to the basic idea of 
a tracking system which enabled them to identify (a) the decisions that made 
the program work as well as (b) the decisions that didn^t click. 

In October^ local directors were shown through discussion of a domographic 
survey instrument that a tracking system is essentially a description of how 
key decisions were made* The group reaffirmed the position that sound decisions 
depend upon sound data. The data ident.ified for collection in the demographic 
survey Instrument were data considered necessary for decisions on the local and 
State level* 



In December 5 local Uirectors sat down and reached ccnmon agreement on how 
a needs analysis should be conducted. Such a formal exchange of ideas was one 
way to identify ^'what worked" and "what didn^t work.*' This Identification 
process formed the first link of a practical tracking syst.aiji,,that could grow 
into a large scale management information system* This exchange forced each 
director to compare "what I did" with "what others did in similar circumstances." 
For example^ a consensus was reached that "selling" the corranunlty program was an 
Important part of successful "needs assessment" when making the first contact 
with governing boards , community leaders j and conffnunity members. Similar lyj it 
was agreed that corranunity education succeeded when corrmunity members realised that 
'This program touches me where I live. It is not a remote agency p far away 
from home*" 



Purpose 

Tracking systems have long had the objective of helping local program 
directors analyse and sharpen their own decision making process skills* 



Out_come_s 



As a result of tracking typical key decisions 5 a inistrators became more 
aware of the following groups of decision^making quest ^ons^ each of which has 
been identified by an adjectives 

Descr Iptlon 

Ad j ecjt D_y 1 s lo n =M ak in g Q u e s t i on^ 

Pragmatic s What worked? 

What didn^t work? 



Inductive: 



What data led to a "what worked" decision? 
What data led to a "what didn't work^* decision? 



Deduct Ive: 



Proiectlve i 



What data did I have? 
What data did I lack? 

Did 1 make a pragmatically successful decision on 
Inadequate data? 

What data do I now need? 
How much of it can 1 get? 

Do I have enough data to allocate resources rationally 
and prudently? ^ 



Tracking, Is Evaluat ion 



The type of evaluation provided by tracking has baen conmonly called 
"formative evaluation^* (a 1972 term) or a "managemeni- infornmtion system" 
(a 1974 terra) ♦ 

Tracking has been equated with evaluation at several different levelss 

_Se If ^evaluat ion i When the program staff reached a consensus 
on *Vhat works," 

Peer - e va 1 ua t loja % When several program directors compared 
notes on "what worked" and offered suggestions on "what I 
would have decided and done." 

Third Party Evaluat ion i Wheii an outside observer impart la 1 ly 
concluded that "What you did in that decision can help solve 
aimilar problems and get worthwhile results elsewhere*" 
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CONCLUSION 



As a result of the Needs Assessment of local program directors conducted 
from September to December 1976p certain needs emerged for the 1977-78 program 
year I 



State Handbook 
Advisory Board 
Delivery System 
Reiource Guide 
Training Workshops 
Data System 

Each of these has been analyzed on the following page in terms of the 
following parameters? 

Short Identification of NEED 
Its PURPOSE 

TOTE OF PRODUCT Needed 
Its SOURCE 
Its FREQUENCY 



I - • Conwunity Education Progratn Niids 




i ■ 

1 




itati Handbook 


Advisory Board 


Delivery Systitn 


Resource Guide 1 


rainini Workshops 


Data System 


PURPOSE 


Suniarlie best 


Provide on^going 


Or|anlj_e regional 


List available 


Respond to needs 


Docufnent the present 


available peer 
and colleagua 
= udgment 


needs aisessnient 
by Involving 
connnunlty leaden 


ripresentatlves 
Into '^ready-to- 
go'' action 
consultants 


and thingi 


assesarnents irom 
local directors 


gtatuS ano aeflio^rdpny 

of Comiinity Education 




Categorize 


Review the procei^ 


Assist new^ 


Identify sources i 


Spongor and_ 


Develop. _strategles 
for (a) recognition 




appropriate 
meaaures of 
auccass 


that led to 
success ot Qut^ 
standing local 
prograniB 


prografna on a 


whati whOj wherij 


organic a 




rggionai dssis 


bny obtEin 

these resourcas 


regional and 

statemde 

workshops 


and visibility; (b) 
funding patterns 




Publicise 
State approved 
priorities 












TYPE OF 

PRODUCT 


DATA (booklit) 


PEOPLE (maetings) 


PEOPLE (list) 
^(niietings) 


THINGS (liit) 


PEOPLE (meetinga) 


DATA (report) 


AUDIENCE 


USA 
NYSED 

Local Directorg 
Local Staff 


NYSED 

Local Directori 


Local Directors 


NYSED 

Local Directors 
Local Staff 


local Directors 
Local Staff 


USA' 
NYSED 

Local Directors 


souRcr 


NYSED 

Local Dirictors 


Cross-Section of 
NYS CltiEeni 


Establiahed 
Local Prograin 
Dir actors 


USA ■ 

NYS Proirains 
NYSED 


NYSED 

Consultants 
Regional 
Representatives 


Local Directori 


FRE(1IJENCY 


Yearly 


Bi41onthly 


Monthly 


Quarterly 

• 


Schedyled 


Setni' Annually 


: ERJC 
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